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This study conducted at a regional midwestern 
university involved the consideration of transcripts, 
personal data, and standardized competency test scores oi 
1195 underclassmen. Variables relating to scholastic 
aptitude and personal characteristics were regressed on 
competency test scores. Results indicated that competency as 
defined by tests is a pure function of scholastic ability 
only at the extremes of the distribution, with personal 
facotrs manifesting increased importance in the definition of 
competency for the majority of the students involved. The 
study suggests the relative importance of the factors studied 
and considers actions which can be takun by faculty, student 
service providers, and administrators in dealing with public 
demands for quality assurance. 
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/ burning issue in higher education in l he mid 19th 
century was the p L ace of the sciences and practical arts in 
the curriculum. Traditionalists bemoaned the retreat from 
the classical program as a weakening of the intellectual 
dimensions of the university. While a great deal of change 
and reform has occurred since that time, the basic premise of 
discussion, what constitutes a quality higher education pro- 
gram, has not changed. 

The Truman Commission Report in 1947 as well as the 
inception of government subsidized veteran education set the 
stage for a movement toward a quasi-universal philosophy of 
higher education. Cross (1971) points to th* explosive 
growth of higher education as the nation's colleges increased 
enrollment from aprrcximately 3% of the college-aged popula- 
tion in 1937 to 37% in 1970. She also cites the change in 
student body composition from a traditional male, white, 
Anglo-Saxon, Protestant base, whose roots lay in the higher 
socioeconomic strata of society to a more equalitarian mix 
which includes women, minorities, low achievers and the impo- 
verished. 

At the same time that this general opening of academe 
was occurring societal pressures were also being exerted upon 
the very nature of the institution. The 1960's brought a strong 
movement toward student involvement in governance, similar in 
many ways to the Ponulist Movement in government. Curriculum 
was impacted in many ways, the most notable being the initia- 
tion of the non-traditional majors and BGS degrees. At 
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npproxJmutcly t lu» niimv lime tlirci' olht"* i hhii •« unicr god— -u 
heightened public awareness of, and involvement with, the 
university itself (Magarrei, 1982; Biemiller, 1982; Jacobsen, 
1985); a declining enrollment base (Mingle, 1981); and rapid- 
ly declining college entrance examination scores (National 
Commission on Excellence in Education, 1983). The outcome of 
all of these factors has been a general questioning of the 
quality of the product being certified by inst cutions of 
higher education in general, as well as public demands for 
quality assurance. 

The institution itself has been aware of the inherent 
quality problems for years. Fritz Machlup sounded z warning 
cry concerning falling quality standards as early as 1970, 
and his concerns were soon echoed by others (Bestor, 1974). 
Meanwhile, attempts were being made to insure quality on a 
grand scale through complete reorganization in seme states 
(Moos, 1981). However, another very different approach has 
been taken in other areas, often due to external political 
pressures. A major thrust in this regard has been the prac- 
tice of manipulating numerical or quantifiable standards to 
assess both individual student and program quality. In- 
various settings GPA requirements, admissions test cut-scores 
and credit hour totals have been used, but a common approach 
has been to adopt norm referenced standardized test for 
purposes of assuring quality, or establishing proficiency or 
competency, depending upon the local situation. This approach 
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to quality assessment has long boe.i associated with public 

elementary-secondary education. Thus, it is very familiar, 
and, on first glance, appealing for its simplicity. As Astin 
(1982) points out, the uso of a standardized test as a 
quality measure leads to ranking of institutions with the 
implicit assurance that the higher the average test scores, 
the higher the quality of the institution. While some type of 
mandated proficiency testing existed in one quar-er of 
the states in 1980 (Kraetsch, 1980), such requirements were 
in place in over half by 1983 (Watkins, 1983). That such 
usage of tests is questionable is indicated by the 
Educational TestingService ' s warning that the practice of 
using standardized test results to judge competency is not 
justified unless such usage is independently validated by 
comparison to known criteria (Preer, 1983). 

This study is a statistical investigation of the scho- 
lastic and personal characteristics of a large group of 
students involved in an exit competency examination program. 
Instruments used were the Pre-Prof essional Skills Tests in 
Math and English, and the Nelson-Denny Reading Achievement 
Test. The initial research was designed to /alidate artifi- 
cially developed cut-off scores, but it soon bec-me apparent 
that such an approach was simplistic. The thrust was then 
changed to study a much more basic set of research q-estions: 
1. What are these tests measuring, or in 
other words, what are the tests suggesting 
about our students? 
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2. Are the nests generating unique information 
or are they redundant with other easily 
obtained measures? 

3. Is it possible to increase tne prob bility 

of student success by more carefully controlling 
his/her early higher educational experiences? 

4. By looking at the interrelationships between 
various quality indicators and the tests, can a 
workable definition of competency be inferred? 

Data Base 

The university setting in which the data was collected 
requires every student to achieve a "passing" score on the 
PPST Math and Writing Examinations, and on the Nelson-Denny 
Reading Achievement Test, as a condition of graduation. The 
cut scores are defined as 172 on the PPST examinations and 67 
on the Nelson-Denny. These points, based upon -1 standard 
deviation in the local population, are somewhat higher than 
the national experience. Direct comparisons to the national 
data are not made, though, since the tests are given national- 
ly for so many reasons that such comparisons are not justi- 
fied. 

The data utilized in the study was transcript infor- 
mation on 1195 Kansas public university students who had 
attempted the Nelson-Denny Reading Test and/or the Pre- 
Professional Skills Test(s) during the 1933-85 academic 
years. Table 1 lists the demographic distribution of the 



ERJ.C 



4 

8 



JOMl'FTKNC Y TESTING 

population. 

Table 1 

Characteristics of the Student Population 



Unit 


No . Sub jec ts 


Mean GPA 




% Pass 










N-D 


PPST 


r?ST 










WRIT 


MATH 


LAS 


318 


2.91 


82. 1 


80.44 


83.5 


Education 


405 


2.99 


78.8 


86.2 


85.8 


Busine ss 


434 


2 .90 


73.4 


84.3 


84.9 


Unclass. 


38 


2.85 


70. 1 


78.1 


94.4 


study the 


phenomenon of 


success/ failure 


, ACT 


scores , 



competency test results, and general education enrollment 
patterns were extracted from each transcript. In keeping 
with the exploratory nature of the study, selected general 
education core course grades were coded, as were personal 
data such as student classification, GPA, and major. 

General education courses taken in each of four basic 
areas — humanities, social science, language arts, and 
natural sciences — were coded by credit hours in the field, 
and student classification uhen the work was completed. This 
data was transformed into a measure of curricular breadth for 
each student. This was accomplished by calculating the pro- 
portion of general education hours taken in each area and 
obtaining a coefficient of variation for each case. The 
depth of the general education experience was defined as the 
total number of non-major freshman-sophomore courses com- 
pleted. Timeliness of enrollment was the proportion 
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of these hours the individual student ha I ompl eted by L ho 

end of the sophomore year. 

A subset of 87 students was randomly chosen from the 
population, and the Text Anxiety Scale was administered to 
them. Results of this testing were added to the existing data 

Statistical Design 
Descriptive statistics, means, standard deviations, and 
frequencies were used to describe the data base. In addi- 
tion, these measures were used to describe the historical 
experience of the student body in regard to the variables 
selected for study. Simple correlation matrices were estab- 
lished to describe variable relationships. A multiple cor- 
relation analysis was performed to assess both the strength 
and the relative importance of the discrete variables as 
predictors of competency test scores. The efficiency of each 
equation was assessed by completing a series of discriminant 
analyses regressing the identified variables on subject suc- 
cess/failure with the three competency exams. The criterion 
in this instance was the proportion of correct predictions of 
observed test outcomes. 

The extremely high correlations obtained between ACT 
scores and the various standardized measures taken tended to 
attenuate the other variables in the data base. Therefore, a 
similar analysis was completed utilizing demographic and 
general education information, but without the inclusion of 
ACT data. 

The records of international students were retrieved 
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i rom the data base and studied as a group to determine 
her the parameters describing their experience differed from 
whether the parameters describing their experience differed 
from those of native speakers. Initial intent was to apply 
univariate tests of significance to this data, but at the 
descriptive level such pronounced differences were encoun- 
tered that meaningf ulness was established without 
application of such techniques. 

Results 

The statistical analysis was conducted in several dimen- 
sions. Quartiles of ACT composite distribution vere cross 
tabulated with PPST results: 

Table 2 

ACT Quartiles Compared with PPST Writing Status* 
ACT Range PPST Pass PPST Fail 



Ql 
Q2 
Q3 
QA 



8-15 
16-18 
19-21 
22-31 



63% 
90% 
95% 
99% 



27% 
10% 
5% 
\% 



Total Pass-Fail Rate 



89% 



11% 



Mean PPST Scores 



176 
S = 6.1 



166 
S=12.5 



0 
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Table 3 

ACT Quartiles Compared with PPST Math Status* 
ACT Range PPST Pass PPST Fail 



Ql ~8-'5 36% 

Q2 16-_d 35% 

Q3 19-21 99% 

Q4 22-31 97% 

Total Pass-Fail Rate 

Mean PPST Scores 180 



64% 
15% 
1% 
3% 



166 



48% 
21% 

4% 

0 

18% 
56 



S=8.2 S=3.5 

Table 4 

ACT Quartiles Compared with Nelson-Dei.ny* 

Pass-Fail Rate 

ACT Ra-ge N-Denny Pass N-Denny Fail 

Ql 8-15 52% 

Q2 16-18 79% 

Q3 19-21 96% 

Q4 22-31 100% 

Total Pass-Fail 32% 

Nel son-Denny MeaT Scores 95 

s=20.0 s=8 .5 

♦Percentages ary from total reported in Table 1, as not 
all students report ACT scores. 

Several observations can be made about these tables. It 
can be noted that the Nel son-Denr. y test appears to act most 
efficiently of the three tests as a scholastic aptitude 
measure. There is a wide spread betwe-n the mean scores 
achieved by successful and unsuccessful students, and fairly 
low variability in the scores of those who failed. The 
pattern of pass vs. fail is quite consistent and dramatically 
discriminatory as scholastic aptitude increases. 
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The P: ^-Professional Skills Tests, however, appear to 

have somewhat less power to discriminate scholastic ability. 
Examination of the mean- and standard deviations indicate 
considerably mere distribution over lap. Indeed, on the math 
test a higher proportion of ^3 students achieved a pass 
status than was the case with QA students. Considering .he 
experience of students by ACT composite score increments 
gives credence to this interpretation, as there is consider- 
able variation in the pass/failure rate as the ACT standard 
score distribution is ascended. For example, for students 
sitting for the English examination who had attained ACT 
scores of 19 (3-d quartile) the proportion, as well as the 
number, of failures was less than for thosa with ACT scores 
of 20 or 21. This same pattern existed across the first 
three quartiies of both th^ math and the English exam. 

Based upon these three tables, several generalizations can 
be drawn. First, it appears that the tests are measuring 
something in addition to scholastic aptitude, or to state 
this point in another direction, raw scholastic aptitude is 
not a completely accurate indicator of measured competency 
except at the extremes of the ability spectrum. Therefore, 
if it is accepted that the tests do measure that quality of 
performance known as competency, and if the pass-fail cut 
scores are valid, the tests cannot be replaced with "imple 
scholastic aptitude measures for the majority of the student 
body. On the other hand, if competency is, as Weaver (1980) 
contends, a function of public perception rather than an 
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intellectual constant, it. is possible that what is appro- 
priate to measure is an intelligence related factor such as 
scholastic ability. 

Multivariate and Univariate Analysis of 
Contributing Factors 

To provide a starting point for multivariate analysis of 

the data, zero order correlation coefficients were run 

between all variables collected. TabJe 5 is the resulting 



matrix, 



Table 5 
Inter Item Correlations 

PPST PPST Nelson ACT ACT 
EN 1 Eli 2 MA 1 GPA Eng. Math Denny Eng. 



EN 1 1.0 ~~ 

EN 2 .488 1.0 

MA 1 .275 .358 1.0 

GPA .553 .582 .506 1.0 

PPST .342 .221 .159 .167 1.0 

English 

PPST .260 .139 .426 .281 .212 1.0 

Math 

Nclsor .351 .379 .22^ .419 .249 .336 1.0 
Denny 

ACT -435 .348 .;.85 .425 .409 .518 .625 1.0 

English 

ACT -291 .264 .427 .398 .272 .693 .474 .53 

Math 

The most noticeable feature of the matrix is the com- 
parative weakness of the individual coefficients, as contrasted 
to the extremely consistent directionality. It is suggerted 
that sil measures are related to the same general area, but 
are measuring those areas (e.g., schoUs ic aptitude) from a 
different perspective. One interesting, and rather curious, 
statistic is the correlation betwoen the ACT English scores 
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and the FFST writing score, as opposed to the relationship 
between ACT and FFST math scores. In the latter case the 
measures covary at a 50% or very high level, while i the 
former the relationship is 16%. Ttis indicates that while 
both tests are measuring approximately the same thing in the 
same way in math, they are measuring something quite differ- 
ent in the English area. 

Multiple regression analysis was performed on each com- 
petency examination by regressing items in the data base on 
each set of exam scores to determine if it was possible to 
build a predictive equation tc assess earlv a student's 
propensity to succeed or fail on the examinations. Since the 
emphasis was upon prediction, all variables which appeared to 
provide a greater than chance discriminatory power were re- 
tained for study. 

In the case of the PPST Math examination, the variable 
with the greatest predictive power was the * . math score, 
acc unting for some 45% of the variance by itself. The next 
best variable indicated by the analysis was GPA, followed by 
Math 1 grade. However, furthe- analysis indicated that GPA 
was more likely acting as a suppressor on the math grade 
variable than as a true predictor. This observation was 
confirmed later in the analysis when the sufficiency of the 
individual indicators was assessed. 

In investigating the PPST English examination, the 
analysis indicated that the predictor variables could account 
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for approximately one-third of the variance. Once again, the 
best predictor was the ACT English score, with the second 
most powerful being the English 1 grade. No other variables 
contributed suf-ficient stability to the equation to be con- 
sidered. 

The analysis of the Nelson-Denny examination revealed 
that two ACT scores, Social Studies . „ English, were the 
most powerful predictors, followed by English I grade. By 
far the most powerful was ACT social studies accounting for 
approximately two-thirds of the explained variance. 

While the above analyses do explain the relationship of 
the various factors in the design, the sufficiency of the 
combinations of variables as actual working models to predict 
success or failure was not clearly assessed by the technique. 
To make this determination, a discriminant analysis was per- 
formed on the data to ascertain how well each set predicted 
the actual experience of the sublets. This type format is 
commonly known as a percentage of correct placements analy- 
sis. Tables 6, 7, and 8 indicate the results. 



Table 6 



Percentage of Correct Placements from 
Pre-^etei mined Variab*^ Set, PPST English Exam* 



Correct Prediction 



Incorrect Prediction 



Pass 
Fail 



99.1% .9% 
88.9% n% 
♦ACT English Score and English 1 Grade 
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Table 7 

Percentage of Correct Placements from 
Pre-Determined Variable Set, PPST Math Exam* 
Correct Prediction Incorrect Prediction 

Pass 99.3 6.7% 

Fail 66.7% 33.3% 

♦ACT Math and Math 1 Grade 

Table 8 

Percentage of Correct Predictions from 
Pre-Determined Variable Set, Nelson-Denny Reading Exam* 

Correct Prediction Incorrect Prediction 

Pass 94,8% 5,2% 

Fail 55.9% 44.1% 

♦ACT Social Studies, ACT English and English 1 Grade 

Three features should be noted from these tables. Most 
importantly, when combined with the examination of the fre- 
quency distributions it must be observed that the strength of 
the ACT predictors will be differential across the distribu- 
tions, being most efficient at the two extremes, Additional- 
ly, in all cases the equations predict succers much more 
strongly than they predict failure. This would tend to 
suggest that something other than scholastic aptitude (ACT 
scores) or performance-motivation (class grades) is operational, 
and that this something is a much more significant factor in 
the case of those who fail the PPST Math and the Nelson-Denny 
test, than the PPST English test. However, a third factor 
which should be recognized is that with all three tests, but 
particularly with the PPST instruments, the predictive power 
achieved through knowledge of the student's ACT scores and 
course grades is considerably greater than chance. 
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Enrollment Patterns as Predictor Variables 
Ge neral education enrollment patterns were analyzed to 
determine whether such patterns affected success on the com- 
petency" examinations . As might be expected, the most predic- 
tive variable for any given test was the total r.^ber of 
credit hours taken in the area being measured by the examina- 
tion. Thus, the best predictor of score on the PPST Writing 
examination was total hours of language credit, while hours 
in math/science was the best predictor of PPST Math score. 
Interestingly, as noted in other studies of a similar 
nature (McPhee & Kerr, 1985), social studies training serves 
as a secondary predictor of math proficiency. 

Discriminant analysis indicated extreme efficiency of a 
predictive equation using proportional distribution of general 
education courses and timeliness of enrollment as predictors. 
Successful students on all three examinations showed a nearly 
equal distribution of natural sciences/math; language/ 
humanities; and social sciences in their general educa- 
tijn program, Unsuccessful students tended to have enrollment 
patterns which upset this balance, and had a tendency to 
specialize in one area during their freshman-sophomore years 
at the expense of the other two. 

Grade Point Average as a Predictor 
Another area of interest was the predictive power of 
GPA. Since a GPA of 2,5 is necessary for graduation, a 
case can be made for this variable being the true measure of 
st jent competence. Tables 9, 10, and 11 report the results 
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of a comparison of these measures. 

Table 9 

PPST Math Status by GPA Category 



GPA Pass Fail 

Above 2.5 90% 10% 

Below 2.5 72% 28% 

Table 10 

PPST English Status by GPA Category 

GPA Pass Fail 

Above 2.5 92% c <% 

Below 2.5 69% 31% 

Table 11 

Nelson-Denny Status by GPA Category 

GPA Pass Fail 

Above 2.5 84% 16% 

Below 2.5 66% 34% 



It is interesting to note that while GPA does tend to 
discriminate, the pattern of the discriminant analysis- 
results — much higher discrimination of success, but con- 
siderably lower of failure — still tends to hold true. A 
peculiarity in the data is the apparent stronger discrim- 
inatory power of GPA alone as opposed to the discriminant 
equation in predicting the unsuccessful condition. This is 
probably attributable to missing data in the discriminant 
analysis rather than power. Careful examination of tne two 
methods of predicting success/failure indicates that the 
discriminant equations are much stronger overall predictors 
than is GPA in forecasting passing/failure. 

15 
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Another area of interest is test anxiety. Carrier and 
Jewell (1966) found that anxiety is related to academic 
performance, and in the case of academic tests success can be 
predicted by self reports of anxiety. If this is indeed the 
case, it seems logical to assume that if the tests are mea- 
suring competency, the area other than scholastic aptitude 
being measured may be the individual's feelings of security, 
or lack of academic anxiety. Current research supports this 
position ( Zigler & Trickett , 1978 ). This area was studied 
by selecting a random sample of 87 students and administering 
the Test Attitude Inventory Table 12 illustrates correlations 
between test anxiety and the various competency measures. 

Table 12 

Coirelations Between Competency Test Scores 
and Test Anxiety Scale Scores for 
Random Sample of Test Takers 
(n-87) 

PPST PPST N-D Total Worry 

Writ. Math 



PPST Writ. 1.0 

PPST Math .21 1.0 

Nelson-Denny .25 .34 1.0 

TAS Total -.41 -.48 -.50 1.0 

TAS Worry -.46 -.48 -.47 .91 1.0 

TAS Emot -.36 -.48 -.45 .96 .81 

The Test Anxiety Scale Total Score is indicative of 
overall anxiety, which can be thought of as insecurity, fear, 
and/or dread of the testing process. Emotionality is a 
subscore which focuses particularly upon the testing situa- 
tion, while Worry is a subscore which assesses insecurity of 
outcomes. Research has demonstrated that these measures are 
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predictive of academic achievement, and has shown a relation- 
ship between such measures and intelligence. However, these 
studies have all been conducted using course grades as a 
criterion. The experience with this group indicates a much 
stronger relationship between text anxiety and competency 
test scores than has been previously assumed. 

Since this data set is too small to subject to multi- 
variate analysis, mean analysis was used to compare differ- 
ences between those who passed and those who failed. Tables 
13, 14, and 15 indicate results of this comparison. It 
should be noted that a higher score indicates greater anxiety, 

Table 13 

Comparison of Test Anxiety Scale Scores 
for Students Passing and Failing the 
Nelson-Denny Reading Examinar ion 



Total 
Worry 

Emotionality 



Mean , 
Pass 

37.0 
13.4 
15.5 



Mean , 
Fail 

49.4 
17.6 
21.3 

Table 14 



■3.5 
■3.1 
■3.9 



.005 
.005 
.005 



Comparison of Test Anxiety Scale Scores 
for Students Passing and Failing the 
PPST Math Examination 





Mean , 


Mean , 


t 


n 




Pa ss 


Fail 






Total 


37.9 


50.8 


-8.4 


.005 


Worry 


13.5 


18.6 


-4.1 


.005 


Emotionality 


16.0 


21 .6 


-3.7 


.005 
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Table 15 



Comparison f Test Anxiety Scale Scores 
for Students Passing and Failing the 
PPST Writing Examination 



Mean f 
Pass 



Mean , 
Fail 



t 



P 



Total 
Worry 

Emotionality 



39.0 
13.7 
16.7 



48.8 
18.9 
20.0 



-3.0 
-3.5 
-1.9 



.005 
.005 
.05 



While there is considerable debate as to just what these 
test anxiety scores mean and how they should be interpreted, 
comparison of the sample demographics with those reported in 
the literature indicate that it is extremely unlikely that 
the reported values are merely a function of scholastic 
aptitude. In fact, it may well be possible that test anxiety 
is responsible in large part for the observed differences in 
performance of students of like scholastic ability. 



International students present an unusual problem in 
regard to tha competency examinations. The data base con- 
tains information on 35 such individuals, and only one oi 
those has completed the ACT examination. Tnerefore, little 
can be done with this data other than describing it. Of the 
students represented, 20 are Arts and Science, 13 are 
Business, and 2 are unclassified students. As a group they 
have achieved a mean GPA of 2.93, with 14 having GPA's exceed- 
ing 3.0. All but two of the grcup completed EN 1. The 
highest grade achieved in that course was an ff A ff (f = 6) and 
the lowest a "D 11 (f«13), with a mean grade of 2.79. Twenty- 
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^ight of the group continued through EN 2, and performed 
somewhat better with two earning "A's", but only 6 receiving 
"D's", and the mean grade increasing to 2.86. Thirty-two of 
these students had attempted the D PST writing examination, 
wr.th only five (15%) being successful. 

The results on the Nelson-Denny Reading Test were even more 
startling. Of the 15 who attempted this examination f only 
one passed. It should be noted that no data was collected on 
the culture-free alternative, the Michigan Test. 

International students fare considerably better in the 
field of mathemecics. The mean grade earned by the 17 who 
completed MA 1 was 2. 94, with a median grade of "B" achieved. 
Of the 17 who attempted the PPST Math Test, 12 passed. 

The data concerning international students is very- 
sketchy, and the total number of subjects is so small that 
complex analysis is not possible. Table 16 demonstrates 
these differences in experience of foreign students and 
native speakers. 



Table 16 



Comparison of Experience of Native Speakers 
and International Students 



Native 
Speakers 



Inter national 
Students 



Combined CPA (Mean) 



2.60 
2.61 
2.79 
8«j . 8% 
78.8% 
2.61 
84.9% 



2.93 
2.79 
2.86 
15.1% 
6.6% 
2.94 
70.6% 



EN 1 Grade (Mean) 
EN 2 Grade (Mean 
PPST Writing Pass 
Nelson-Denny Pass 
MA 1 Grade (Mean) 
PPST Math Pass 



Study of these data lead to disturbing conclusions. The 
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GPA represents some 30 separate, and largely independent, 
measures on scholastic ability which are gathered from across 
the campus. In this regard, it appears that the overall 
demonstrated proficiency of international students is slight- 
ly higher than that of native speakers. Additionally, if the 
problem is nothing more than a simple inability to manipulate 
the language, this fact is not being reflected in English 
courses, where, again, the performance of international stu- 
dents exceeds that of native speakers. Thxs superior perfor- 
mance is even more striking in the field of mathematics. 
However, the success of international students is poor beyond 
reasonable explanation on the competency examinations. This 
can only lead to the conclusion that the tests or the testing 
situation itself, contains a cultural bias. The use of the 
instruments to assess competency with international students 
is therefore questionable. 

Discussion 

Data analyses allow conclusions to be drawn regarding 
the four major questions posed at the beginning of this 
article. First, competency tests appear to primarily dif- 
ferentiate students on the basis of scholastic ability. The 
categorization of students is sharpest with the Nelson-Denny 
examination and somewhat less with the Pre-Prof essional 
Skills Test. While it appears that the PPST Math Test 
results are more understandable in terms of scholastic apti- 
tude than the English examination, both tests seem to work 
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most effectively at the two extremes of the scholastic apti- 
tude continuum. At the upper <in<l lowor end of the ' .ixly 
scale, the information yielded by the competency t xarrs is 
redundant with similar information yielded by ACT scores. 
Or, to state the situation in different terms, there seems to 
be a threshold level at both ends of the ability continuum 
where the tests tend to become purely scholastic aptitude 
measures. The range of this zone at the upper end of the 
continuum is far greater than is the case with the lower end. 

Since the tests worl differently at the extremes of the 
distribution, a strong possibility exists that patterns of 
relationships within the central part of the data set are 
attenuated in this study. For example, while it appears that 
scholastic ability accounts for approximately half of the 
success or failure on competency examinations, it may be that 
most of this can be attributed to the experience of bright or 
slow students, and for those between the extremes something 
other than scholastic ability is the primary factor. As 
funds and time permit, it would seem reasonable to isolate 
the students in the central part of the distribution and 
study their characteristics separately. 

A second conclusion which can be drawn is that the 
multiplicity of tests administered provides little "new" 
information about students. Utilizing cut scores on entrance 
examinations, it would be possible to excuse a considerable 
number of students from the competency testing requirements, 
thus saving ccasiderable time and money for all concerned. 
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A t^ird conclusion is that variables do exist which if 
evaluated early in the student's academic career can increa&t 
their success on competency tests. Extremely low entrance 
examination scores can be used to assign students to high 
risk categories. Treatment tailored to the specific nature 
of the individual's needs can be applied in advance of the 
time during the student's career when competency tests are 
given. Passing scores appear to be related to enrollment in 
courses relevant to the type of tes, taken. Language arts 
courses correlate highly with the PPST Writing exam, 
humanities coursework correlates with the Nelson-Denny 
Reading exam, and natural science courses correlate with the 
PPST Math exam. The University of Arkansas at Pine Bluff 
has had significant success in improving test scores of 
similar students through teaching test taking strategies 
(Hackley, 1985). Thi3 would seem to fit extremely well with 
Astin's (1982) value-added model of excellence in education. 
Further information should be gathered concerning the nature 
of student characteristics which impact on successful/unsuc- 
cessful experience on competency examinations. Of particular 
value would seem to be studies of test anxiety and patterns 
of general education enrollment. In general, breadth of 
general education preparation tends to improve competency 
test performance. It is recommended that the competency 
testing requirement not be applied to international students, 
but rather be offered as an option. While it is not possible 
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at this time to define the probl , it is obvious that all 
three examinations seem to contain systematic bias when ap- 
plied to international students. If, indeed, tl^re is insti- 
tutional concern regarding proficiency of foreign students, 
the answer would seem to lie in raising admission require- 
ments. Clearly, as the data supports, the use of an exit 
exam is not a viable alternative. 

A :jos t disturbing extension of fhese conclusions is 
that the study indicates that what is being measured by the 
new "competency 11 examinations is not any new dimension of 
student hrhavior, but rather the same type of ability- 
achievement-aptitude which is measured in so many ways in 
education. However, if as this study suggests, students who 
are otherwise in good standing are being eliminated by tests 
designed to measure minimal scholastic aptitude, the entire 
system of entrance and quality control standards currently in 
place is open to question. Since this cutting of students 
occurs fairly late in the students 1 college career, it is 
imperative that *urther work be conducted to define competen- 
cy, and to ascertain the most effective way to measure the 
concept • 

Unless this is dene it appears that for the students in 
the center of the ability spectrum, what is being measured by 
the standardized tests may not relate to competence, while 
for the students at the extremes, the examinations are use- 
less hurdles to be overcome. 

Dealing with a competency testing program is problem- 
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atic. Obviously, the ideal situation would be one in uhich 
extremely rigorous instruments are used, but all students 
pass. The reality of both human nature and the fraility of 
empirical measures is such that a system of this type cannot 
exist. But, it seems, all institutions strive toward such a 
Utopian design. 
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